Markov Projections of the Voter Model 
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A general framework of aggregation for the Voter Model (VM) is developed which exploits the 
symmetries of the agent network G. Depending on the symmetry group Aut(G) of the graph, certain 
ensembles of agent configurations can be interchanged without affecting the probabilistic structure 
of the VM. These nodes can be aggregated into the same macro state and the dynamical process 
projected onto these states is still a Markov chain. The method informs about the complexity of a 
system introduced by heterogeneous interaction relations. In some cases the macro chain is solvable. 



Agent-based models (ABMs) are from a formal point 
of view Markov chains p], However, there is not too 
much to learn from this fact alone as the state space of 
the chains corresponding to those models (consisting of 
all possible configurations of agents) is tremendous. For 
the analysis of a model, therefore, a considerable reduc- 
tion of the state space is required. In practice, the models 
are often re-formulated in terms of an aggregate variable 
(such as magnetization) so that all micro configurations 
with the same aggregate value are agglomerated. How- 
ever, for inhomogeneous agent networks the dynamical 
process at a coarse-grained level obtained in this way is 
in general no longer a Markov chain 0|. In this case, the 
results are usually considered as an approximation and 
compared to simulations. Another possibility, however, is 
to refine the aggregation procedure such that the Markov 
property is not lost and try to solve the refined problem. 
In this Letter a systematic approach to aggregation is 
developed which exploits all the dynamical redundancies 
that have its source in the agent network on which the 
model is implemented. 

We use the Voter Model (VM) to exemplify our ap- 
proach (see Refs. The VM has its origin in the 
population genetics literature but due to its interpre- 
tation as a model for opinion dynamics it has become a 
benchmark model in social dynamics. The reader is re- 
ferred to Ref. [1| for a recent review of related models in 
population genetics and to Ref. [Io| for an overview over 
the social dynamics literature. 

Consider a set N of N agents, each one characterized 
by an individual attribute Xi which takes a value among 
two possible alternatives: Xi G {□,■}, i = 1,...,N. 
Let us refer to the set of all possible combinations of 
attributes of the agents as configuration space and de- 
note it as £ = {□, M} N . Therefore, if x G £ we write 
x = (xi, . . . , Xi, . . . , xn) with Xi G {□, ■}. The agents 
are placed on a network G = (N, E) where N corresponds 
to the set of N agents and E is the set of agent connec- 
tions In the dynamic process implemented in the 
VM an agent i is chosen at random along with one of its 
neighboring agents j. If the states (xi,Xj) are not equal 
already, agent i adopts the state of j (by setting Xi = Xj). 
The model has two absorbing states corresponding to the 
configurations with all agents holding the same opinion 
(consensus). The exit probabilities depend on the initial 
fraction of individuals in the respective state: for final 
consensus x = (■, ...,■) and 60 black agents at t = we 
have P> (&o) = bo. Analytical results for the mean conver- 
gence times have been obtained for the complete graph 



il, for d-dimensional lattices 1,(0411 as well as for 
networks with uncorrelated degree distributions @, [1] ■ 

At the microscopic level of all possible configurations 
of agents the VM can be seen as an absorbing random 
walk on the A^-dimensional hypercube with the two ab- 
sorbing states (■, ...,■) and (□, . . . , □). This is shown 
for the example of three agents in Fig. Q] Due to the 
sequential update process, from one interaction event to 
the other, only one agent changes or the configuration 
remains as it is (loops are not shown in Fig. []}. That 
is, non-zero transition probabilities exist only between 
configurations that are adjacent in the hypercube graph. 
Let us therefore call two agent configurations y, x G £ 
adjacent if they differ only with respect to a single agent 

i. We denote this by x ~ y. 
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FIG. 1. The micro chain for the VM with 3 agents and its 
projection onto a birth-death random walk obtained by ag- 
glomeration of states with the same number of black agents b. 

The transition probabilities associated with the arrows 
in Fig. [1] depend only on the probability with which 
an agent pair is chosen such that their opinions 

(xi, Xj) result in the respective transition. Different agent 
interaction networks have therefore a crucial effect on 
the transition probabilities of the micro chain. Let us 
denote by A the adjacency matrix of G such that Oy = 
states that there is no connection from agent i to j and 
<Xij > that such a connection exists with a strength 
given by ay. We assume in the following the VM with 
link update dynamics such that an agent pair is selected 
for interaction by a random choice of a link (i, j) as is 
often convenient for heterogeneous graphs (see [10] : 601). 
The probability of finding an agent pair is then 

prr where |E| is the sum over all edge weights. With 
these definitions the transition probability for adjacent 
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configurations with x ~ y is given by 

This is the conjoint probability to find an agent pair 
so that the ith agent has to change his opinion. Notice 
that for an undirected, unweighted graph the sum corre- 
sponds to the number of neighbors in conflict with i and 
|E| is the number of edges in G. SeeRef. 0, Eq. (4), for 
similar a expression in a more general setting and Ref. 
0, Eq. (9), for the VM with node update dynamics. 

Notice that, at this level, the dynamics of the model is 
defined in the configuration space with 2 N states, which 
seeks to describe the dynamics of each agent in full de- 
tail. Following we refer to this as micro dynamics. As 
the number of states increases as 2 N with the number of 
agents, it is not convenient to study the models dynamics 
at the micro level, ft is often more convenient to refor- 
mulate the dynamics in terms of a macroscopic aggregate 
variable. In the VM, the number 6 of black agents i with 
Xi = ■ or the respective density are natural choices. Fig. 
[T] illustrates how several micro configurations with the 
same 6 are taken together to form a single macro state. 
Notice, that in the hypercube terminology b corresponds 
to the Hamming weight of a configuration. 

It is well-known that the macro model obtained in 
terms of b fully describes the evolution of the micro model 
on the complete graph (0:3), but that " [n]onregular 
topologies have nontrivial effects on the ordering dynam- 
ics of the voter model " ([13:601). The (probabilistic) 
reason for this is that the complete graph is the only 
topology for which the transition probabilities of the new 
macro process are uniquely defined. Only in that case 
configurations with the same Hamming weight b can be 
interchanged without changing the probability structure 
of the random walk on the hypercube (see [l4|]:24 or 
[l3:8). For instance, in the example shown in FigQJ 
the probability ([I]) of a transition form configuration "e" 
to "h" is P(e,h) = («i2 +a 13 )/|E|, from "f" to "h" 
we have P{f,h) = (a 2 i +a 23 )/|E| and for "g" to "h", 
P(g,h) = (031 +d32)/|E|. While all these probabilities 
are equal for the complete graph (as ay = 1 : Vi, j) they 
are not all equal if one or two connections are absent. 
For example, if 023 = a 32 = (see Fig. \2§ we have 
P(e,h) 7^ P(f,h) = P(g,h). In that case, the macro 
process shown in Fig. [1] is no longer a Markov chain and 
the formulation of the voter model in terms of b does not 
any longer completely describe the system. 
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FIG. 2. The 3 different configurations "e", "f" and "g" of 
length 3 with one agent in ■ and two in □ (b — 1). The first 
two configurations are macroscopically equivalent. 

Deriving such a complete description in form of a 



Markov chain requires a refinement of the aggregation 
procedure. We have to identify bundles of micro config- 
urations that can be interchanged without changing the 
hypercubic micro chain. These bundles - henceforward 
called partitions - would then define a coarse-grained 
description of the micro process which still captures the 
dynamics in full detail. 

For this refinement, we can make use of a theorem in 
Markov chain theory that gives necessary and sufficient 
conditions for partitioning the state space of Markov 
chains in such a way that the micro process projected 
onto that partition is still a Markov chain. This so-called 
lumpability theorem is presented in (l6| Thm. 6.3.2. Let 
p x Y denote the conjoint probability for x G S to go to 
elements y £ Y where Y C X is a subset of the con- 
figuration space. The lumpability theorem states that a 
Markov chain (P, S) is lumpable with respect to a parti- 
tion X = (Xi, . . . , Xp) if for every two subsets Xk and 

Xi the sum p x x t = X) Pxy ^ s ec l ua l f° r all x S Xf.. More- 
y&x, 

over, these common values form the transition probabil- 
ities P(Xk —> Xi) for a new Markov chain (P,X). For 
further convenience we define: 

Definition 1.1 Two configurations x and x' are macro- 
scopically equivalent if they belong to the same subset Xk- 

Because the transition probabilities (JTJ of the micro 
process depend on the adjacency relations in the agent 
graph G, the structure of G plays a decisive role in the 
construction of lumpable partitions of the configuration 
space X. In fact, as will be shown in the sequel, the sym- 
metries of G dictate an appropriate partitioning. Let us 
consider again the example of three agents now connected 
as shown in Fig. [5] (023 = a 32 = 0). This graph has a 
reflection symmetry such that the nodes 2 and 3 can be 
permuted without affecting the connectivity structure. 
This symmetry imposes a symmetry in the hypecubic 
graph associated to the micro process such that the con- 
figurations "f" and "g" with 6=1 and respectively "b" 
and "c" with 6 = 2 can be permuted without affecting 
the transition probabilities. This motivates the notions 
of macroscopic equivalence because the macro evolution 
of the model (P, X) is the same for these configurations 
and we can lump them into a single macro state. 

More formally: the symmetries in G are captured by 
its automorphism g roup , denoted here as Aut(G) or sim- 
ply Q (see e.g., (l7l. [l8j). The group Q is defined as the 
set of all isomorph mappings of a graph onto itself. In 
other words, Q is the set of all permutations a on the set 
of nodes (here the set of agents N) such that every two 
nodes/agents linked by a.y in G are linked by the same 
value in the image o~G of G, that is: a.y = a a i a j : V(i,j). 
It is well-known (cf. [I3|:38) that the automorphism 
group Q acting on the set of agents N = {1,2,..., N} 
induces an equivalence relation on N such that two la- 
beled graphs G\^Gi are called Q -equivalent if and only 
if there is a a G Q such that G\ = crG 2 . The equivalence 
classes with respect to Q are usually called Q -orbits and 
the equivalence class that contains the labeled graph G\ 
is defined by Q o G\ := {aG\ : a G Q}. 

A configuration x of the VM can be seen as a graph of 
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size N labeled using a set of two labels S = {□,■}. Let 

us define permutations on x = (x\, . . . , Xj, . . . , Xjy) G £ 
by o~(x) = (x a x, • ■ • , x CT j, . . . , x&n)- As before the auto- 
morphism group of the agent network Q defines equiva- 
lence classes of configurations such that Q o x := {c(x) : 
(7 G t?} is the set of all configurations that are Q- 
equivalent to x. The following Proposition states that 
these configuration then are macroscopically equivalent: 



Proposition 1.1 Let Q be the automorphism group of 
the agent network G. Two configurations x and x' are 
macroscopically equivalent if there exists (at least) one 
permutation a G Q such that x = cr(x'). The respective 
partition X is defined by the orbits that Q induces on X. 

Proof. Consider a graph G and denote the permutations 
in the automorphism group by Ui G Q, i = 0, . . . , \Q\. 
Suppose we know (at least) one configuration (the gener- 
ator) ti> G £ for each Xj C X and construct the partition 



X=(X 1 ,...,X j ,...)by 



\g\ 



•Y, Q • = \Ja t (x 3 ). 



(2) 
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A necessary and sufficient condition for lumpability is 
that the p x y be the same for all x G X and any pair of 
subsets X and Y (Thm. 6.3.2 in [16]). Due to the micro 
structure of the VM, this is satisfied whenever p xy = 
Pcr(x)a(y) f° r any °~ & Q (cf- Prop. 3.1 in Q). For the 

case that x ~ y we know that xj = yj for all j except 
i and that the transition requires the choice of an edge 
(i, ■)■ Denoting Xi = s and yi = s we rewrite Eq. (TTJ) as 



1 

lEi 



E 



(3) 



If x ~ y it is easy to show that <r(x) ~ o~(y) and we 
know that s = o~(x a i) ^= cr(y a .j) = s. The transition 
therefore requires the choice of an edge (eri, . ). We obtain 



Pcr(x)a(y) 



1 

IEI 



E 

k:(tr(x k ) = 



(4) 



Given an arbitrary configuration x, for any j with Xj = s 
we have one k = aj with a(xt) = s because ij = 
o~{x a j) = s. That is, the summations in Eq.Q and (U) 
are equal for any a for which atij = a a - la j. This is true 
by definition for all permutations in the automorphism 
group a G Q. ■ 

Consider as a first example the complete graph (if/v) 
which has been discussed previously by several authors, 
including (H, Q. The automorphism group of Kn is the 
symmetric group {Aut{K^) = 5jv), that is, the group of 
all permutations of N agents. Therefore, for any two con- 
figurations x, x' with equal b there is a a G iS/v such that 
x = (t(x'). Hence, an equivalent aggregate value b implies 
macroscopic equivalence. The fact that this is only true 
for complete graph, or respectively homogeneous mixing, 
underlines the theoretical importance of this topology. 



The associated macro process on the partition X = 
(Xo, . . . , Xb, ■ ■ ■ Xn) is a simple birth-death random 
walk with P(X b -> X b±1 ) = b -^^-, P(X b ->. X b ) - 

b +< ^T^ . In 0| we have derived a closed-form expres- 
sion for the fundamental matrix of that Markov chain for 
arbitrary N. Encoding the recurrence and hitting times 
of the system, this provides all the information to char- 
acterize the distribution of convergence times. For in- 
stance, for the VM starting in a state with b black agents 
the mean time to reach consensus is given by 



n 



N 



6-1 

E 



(N-b) 
(N-j) 



N ~ 1 h 
j=b+i J 



(5) 



We also considered in [2j the VM with more opinions and 
confirm by lumpability arguments that the convergence 
times are as in the binary case, which was shown previ- 
ously in Ref. @. 




FIG. 3. A two-component graph with two homogeneous sub- 
populations. 

The method also yields a very intuitive aggregation for 
structured populations as shown in Fig. [3J Consider a 
graph with two completely connected subpopulations of 
size L and M (L + M = N) and homogeneous influences 
across the two clusters. In population genetics this is 
called the island model [19| . The automorphism group 
of such a structure is Q = (1 . . . L)(L + 1 . . . N). There 
are exactly L\M\ automorphisms because Q is composed 
of the symmetric group Sl and Sm acting on the homo- 
geneous subgraphs. Therefore, the state of the system 
is completely characterized by the numbers bh and 6a/ 
of black agents in either subgraph because all configura- 
tions x and y with 6l(x) = &t(y) (~l £>m(x) = 6m(j/) are 
within the same equivalence class. As < b^ < L and 
< &m < M the aggregation defines a Markov chain with 
(L + 1)(M + 1) states which is still very small compared 
to the number of 2^ L+M ) micro configurations. Notice 
that this generalizes naturally to a larger number of sub- 
graphs. Notice also that the multipartite graphs studied 
in [7| fall into this category and that the authors used the 
respective sub-densities in their mean-field description. 

The cases of homogeneous graphs or graphs composed 
of homogeneous sub-graphs are particularly simple be- 
cause it is intuitively clear which configurations can be 
aggregated. However, Prop. 11.11 generalizes to networks 
with arbitrary automorphisms which we illustrate at the 
example of the ring graph. The ring with nearest neigh- 



bor interactions is defined by au = 1 whenever 



■J\ 



1 



and a Ari = aijy = 1. It possesses an invariance with re- 
spect to translations such that the automorphism group 
consists of all cyclic shifts of agents Q = Cn- Let us define 
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the simple shift as 01 (1, 2, . . . , N) = (N, 1, 2, . . . , N - 1). 
The automorphism group is the set of repeated appli- 
cations of a\\ Q = {<7fc = a\ : k = 1,...,N} where 
er^ = Co is the identity permutation. Notice that trans- 
lational symmetries of this kind also play an important 
role in the determination of the relevant dimensions of 
spin rings (2p| and that there are interesting parallels in 
between the two problems. 

Consider a ring of five agents (N = 5) with 2 5 = 32 
micro states. For x = (■■■■■) it is clear that Ck(x) = 
x for all k. That is, x = (■■■■■) with b = 5 constitutes 
a class of its own. For b = 4, we may use x 1 = (□■■■■) 

as a generator in Eq. {2} . As all 5 configurations with b = 
4 can be obtained by a shift of x , all of them are in the 
same equivalence class (e.g., ^(x 1 ) = (■■□■■)). The 

10 configurations with b = 3 cannot be lumped into the 
same macro state. There are two classes differentiated 
by the distance of zero or one in between the two black 
agents (see Fig. 2]). Using the two configurations shown 
in Fig. [?] as generators, Q o x J yields two equivalence 
classes each containing five micro states. The cases b = 
2,1,0 follow by symmetry so that all in all the dimension 
X of macro chain is reduced to 8. 




FIG. 4. Two configurations with equal b which are not macro- 
scopically equivalent for the ring with N = 5. 

In the general case of N agents we can in principle 
proceed in the same way. However, the number of macro 
states will increase considerably with the system size. We 
finish this Letter with a quantification of this number for 
the ring for which we can use a well-known enumeration 
theorem due to Polya (see (l7j:35-45. Eqs.(2.2.10) and 
(2.4.15) in particular). According to this, the number of 



macro states is 

i x i = ^E^ fc ) 2f ( 6 ) 

k\N 

where ip(k) is the Euler (^-function and the sum is over 
the divisors k\N of TV. As an approximation we have 
X| 2 N /N. Hence, an explicit solution of the macro 
chain will be possible only for very small systems. 

In conclusion, this Letter describes a way to reduce the 
state space of the VM by exploiting all the dynamical re- 
dundancies that have its source in the agent network. In 
the aggregation of micro states into macro atoms follow- 
ing this proposal no information about the details of the 
dynamical process is omitted. However, it is clear that in 
heterogeneous interaction substrates with a small number 
of automorphisms the coarse-graining is limited because 
only a few micro states are macroscopically equivalent 
and can be lumped. On the other hand, the method in- 
forms us in this way about the complexity of a system 
introduced by non-trivial interaction relations. Even in 
a model as simple as the VM, the behavior of whole sys- 
tem is not completely described by summation over its 
elements (aggregation in terms of b) , because non-trivial 
dynamical effects may emerge at the macro level. In 
fact, Markov projections as discussed here in the con- 
text of the VM may provide explicit knowledge about 
the (in) compressibility of computational models which 
is one of the keyconcepts in the area of computational 
emergence ([21II22I]). 

The probabilistic setting we adopt allows to relate mi- 
croscopic agent dynamics to the macro evolution of aggre- 
gate observable variables and shows how network hetero- 
geneities translate into heterogeneities in the dynamical 
structure of the model. A characterization of the dy- 
namical effects that may emerge at the macro level will 
be addressed by future work. 
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